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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 

THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1,136 (a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will 

be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this 

communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 

earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 ) B Responsive to communication(s) filed on Aug 13. 2001 



2a) B This action is FINAL 2b) □ This action is non-final. 

3) □ Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Qu?j*/§35 c.D. 11; 453 O.G. 213. 

Disposition of Claims 

4) B Claim(s) 1-36 is/are pending in the applies 

4a) Of the above, claim(s) is/are withdrawn from considers 

5) □ Claim(s) is/are allowed. 

6) B Claim(s) 1-36 is/are rejected. 

7) □ Claim(s) is/are objected to. 

8) □ Claims _ are subject to restriction and/or election requirem 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are objected to by the Examiner. 

1 !)□ The proposed drawing correction filed on is: aP approved b)E]disapproved. 

12) D The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 1 19 

13) D Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d). 
a)D All b) □ Some* c) CNone of: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 



3. □ Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
*See the attached detailed Office action for a list of the certified copies not received. 

14) □ Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 119(e). 
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1. This Office action is in response to the amendment filed 8/13/01. Claims 26-36 have been 
added. 

2. The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

3. Claims 33 and 35 are objected to because of the following informalities: Due to an error 
on the part of the applicant, claims 32-37 have been renumbered 31-36 by the Office. However, 
with this correction, claims 33 and 35 now depend on themselves. Also, the dependency of new 
claims 34 and 36 should be changed to 32. Appropriate correction is required. 

4. Claim 36 is objected to because of the following informalities: The phrase "display of 
displaying a picture" seems incorrect. Perhaps the claim should read -step of displaying a 
picture--. Appropriate correction is required. 

5. Claims 1-6, 1 1-15, 19-26, 29-33, and 36 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Yokoyama et al in view of Knoll et al. 

For claim L the apparatus for providing information to the driver of a vehicle taught by 
Yokoyama includes the following claimed subject matter, as noted, 1) the claimed positioning 
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device is met by the current position detector (No. 12) receiving inputs from sensors for GPS, 
Direction, distance and steering (Nos. 14, 16, 17, 19) which determines the location of a vehicle, 
2) the claimed storage device is met by the map information storage (No. 10) including stored 
information about the location of a desired driver action such as the distance before a turn is to be 
made, and 3) the claimed comparator is met by the arithmetic control (No. 22) with its built-in 
route computer (No. 22) which compares the location of the vehicle with the stored information 
about the location of a turn and which provides an audible signal when the location of the vehicle 
is in a predetermined relationship to the location of the turn. However, although there is a display 
unit (No. 28) associated with the system, it is not a display on a windshield. 

The en route vehicle guidance system with heads up display taught by Knoll includes 
similar subject matter as the primary invention, most notably a positioning and navigation system 
with simple route entry methods. As seen in Figures 1-7, simple turning directions are presented 
to the driver as well as vehicle speed and engine rpm. As stated in the specification (Col. 7, Lns. 
26-3 1), the purpose of the heads up display is to enable the driver to recognize indicators, such as 
speed and traffic information even if his attention is directed to the traffic situation and without 
having to remove his eyes from the road. The need for adjustment of the eyes of the driver is 
eliminated to a large extent. 

The reference taught by Yokoyama presents an ideal platform onto which a heads up 
display may be applied. The information needed to enable a display is already present to drive the 
display (No. 28) already present. It would have been obvious to one of ordinary skill in the art at 
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the time the invention was made to include a heads-up display similar to Knoll into the primary 
reference for the purpose of enabling the driver to recognize simple driving directions without 
having to remove his eyes from the road. 

For claim 2 . the projector of Knoll is a heads up display. 

For claim 3 , both references provide audible indicators of a message in response to the 
direction signal. 

For claim 4 , the audible indicator of Yokoyama includes a speech synthesis system which 
provides an audible message. 

For claim 5 . the speech synthesis system of Yokoyama provides an audible message 
which is based on the upcoming turn required by the driver. 

For claim 6 . as seen in the description of the Yokoyama system in relation to Figure 14, a 
first indicator is given at a first distance such as 300m from the desired location and a second 
indicator at a second, shorter distance such as 100m from the desired location is given. 

For claim 11 . the method of providing driving instructions taught by Yokoyama includes 
the following claimed subject matter, as noted, 1) the claimed sensing the position of the vehicle is 
achieved using the current position detector (No. 12), 2) the claimed comparing the position of 
the vehicle with a desired location is achieved using the arithmetic control (No. 20) with route 
computer (No. 22), 3) the claimed generating a signal is achieved using the display unit (No. 28) 
and speakers (No. 34) that indicates that a driver should turn if the vehicle is at a predetermined 
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distance with respect to an upcoming turn. However, although there is a display unit (No. 28) 
associated with the system, it is not a display on a windshield. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 1 above. 

For claim 12 , the both references provide audible signals indicating the driver should turn 
at an upcoming location. 

For claim 13 . the system of Knoll presents the information on a windshield. 

For claim 14 . the system of Yokoyama includes several speakers (No. 34) to broadcast 
message thereon. 

For claim 15 . Figure 3 of Yokoyama displays a distance to the next crossing. 

For claim 19 . the predetermined relationship of Yokoyama is distance to the upcoming 

turn. 

For claim 20 . the program stored on a storage medium for generating a displayed message 
to a driver taught by Yokoyama includes the following claimed subject matter, as noted, 1) the 
claimed program element for determining a message for display is contained within the route 
guiding unit (No 26) that determines what direction should be given at the next upcoming turn, 2) 
the claimed program element for determining an appropriate time is contained within the route 
computer and arithmetic control (No. 20) that determines when the instruction should be given, 
and 3) the claimed program element coupled to a projector is contained within the hardware of 
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the display unit (No. 28) that displays messages at the appropriate time. However, this message is 
not displayed on the windshield of the car at the appropriate time. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 1 above. 

For claim 21 . the system of Yokoyama determines the message to display based on the 
upcoming turn and the direction to take thereby. Also, the system determines based on distance 
prior to the location of the turn for the driving instruction to be both displayed and announced on 
the audible system. 

For claim 22 , one determining system to locate the car in the system of Yokoyama is a 
GPS receiver (No. 14). 

For claim 23 , the GPS system of Yokoyama receives its instructions from a remote 

source. 

For claim 24 . the system of Yokoyama includes a route guiding unit (No. 26) located in 
the arithmetic control (No. 20) that provides the navigation to the system. 

For claim 25 . the service for providing information to the driver of a vehicle taught by 
Yokoyama includes the following claimed subject matter, as noted, 1) the claimed receiving at 
least one desired destination is achieved using the map information storage (No. 10) having 
destinations that are input by the driver to drive to, said information storage also 2) determining a 
route along with the arithmetic control (No. 20) with route computer (No. 22) to reach the 
destination including at least one intersection to be traveled, 3) the claimed determining the 
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location of the vehicle is achieved using the current position detector (No. 12) that determines 
when the vehicle is reaching an upcoming turn and providing a message through the display unit 
(No. 28) and the speakers (No. 34). However, the message is not displayed on the windshield 
when the vehicle is approaching the one turn. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 1 above. 

For claim 26 , the system for displaying information to a driver in a vehicle taught by 
Yokoyama includes the following claimed subject matter, as noted, 1) the claimed location 
system is met by the GPS receiver (No. 14) and direction sensor (No. 16) which determines the 
location of the vehicle, 2) the claimed storage device is met by the map information storage (No. 
10) which provides pictures of the roadway near the location of the vehicle in response to the 
location of the vehicle, and 3) the claimed device which generates a display is met by the display 
unit (No. 28) which displays the picture of the roadway. However, the picture is not on the 
windshield of the vehicle allowing the driver to see the display without removing his eyes from the 
roadway. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 1 above. 

For claim 29 . the pictures seen in Figures 2 and 3 of Yokoyama include driving directions. 

For claim 30 . the driving instructions in Yokoyama are in the form of a turn indicated on 
the picture of the roadway. 
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For claim 3 1 , the pictures shown in Yokoyama have been taken and stored in memory 
(No. 10). 

For claim 32 , the method for displaying information to a vehicle driver taught by 
Yokoyama includes the following claimed steps, as noted, 1) the claimed determining the position 
of the vehicle is achieved using the GPS receiver (No. 14) and direction sensor (No. 16) which 
determines the location of the vehicle, 2) the claimed finding a picture of an intersection is 
achieved using the map information storage (No. 10) which provides pictures of the roadway near 
the location of the vehicle in response to the location of the vehicle, and 3) the claimed displaying 
the picture of the intersection is achieved using the display unit (No. 28) which displays the 
picture of the roadway. However, the picture is not on the windshield of the vehicle allowing the 
driver to see the picture while looking out the windshield. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 1 above. 

For claim 33 , the method taught by Yokoyama retrieves stored pictures of the 
intersections from memory (No. 10). 

For claim 36 , Figures 2 and 3 of Yokoyama add driving instructions to the display. 



6. Claims 7 and 17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yokoyama et al in view of Knoll et al as applied to claim 1 above, and further in view of Davis 
et al. 
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For claim 7 , the combination of references includes the claimed subject matter as discussed 
in the rejection of claim 1 above. However, neither reference includes an indication that the driver 
did not make the desired driver action, whereby the driver receives an indication of the missing of 
the desired driver action after the action was missed. 

The automobile navigation system using real time spoken driving instructions taught by 
Davis provides spoken instructions to the driver of an automobile to guide the driver along a 
route. This invention, called the "Back Seat Driver", contains a map database and route finding 
algorithm. A position sensor tracks the location of the automobile. Spoken instructions are then 
given well in advance of an upcoming turn to guide the driver to their destination. An important 
aspect of the system is to notify the driver that a mistake has been made (Col. 2, Lns. 50-53) and 
then finds a new route from the current location. The obvious advantage of this property is to 
prevent the driver from getting lost in an unfamiliar area. 

All three references pertain to similar subject matter; that is, the navigation of vehicles 
using graphic and speech synthesis. The Yokoyama reference in particular stops its speech 
production when the driver has deviated from the set course. This system would greatly benefit 
from the self-correcting system of Davis. It would have been obvious to one of ordinary skill in 
the art at the time the invention was made to include a notification that a turn has been missed in 
the combination of reference above for the purpose of preventing the driver from getting lost in 
unfamiliar territory. 
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For claim 17 , the combination of references includes the claimed subject matter as 
discussed in the rejection of claim 1 1 above. However, neither reference includes an indication 
that the driver did not make the desired driver action, whereby the driver receives an indication of 
the missing of the desired driver action after the action was missed. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 7 above. 

7. Claims 8-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Yokoyama 
et al in view of Knoll et al as applied to claim 1 above, and further in view of Ohmura et al. 

For claims 8-10 . the combination of references includes the claimed subject matter as 
disclosed in the rejection of claim 1 above. However, there is no wireless receiver which receives 
broadcast traffic information, weather information, or advertising information. 

To access this information in a navigation apparatus is not new in the prior art. The 
navigation apparatus taught by Ohmura provides a driver with necessary information without 
offering an excessive amount of information. This is achieved by setting priority to different types 
of information to be received. As seen in Figures 3B and 6 of the invention, a myriad of 
information types can be accessed by the apparatus. The information handled by this system is 
provided by Vehicle Information Control System, audio equipment, radio, on-vehicle telephone, 
tele-text broadcasting and the like. The type of information presented can be urgent information, 
traffic, weather, sports, news, and music titles. 
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The Ohmura reference is plain evidence that a myriad of information can and has been 
received in conjunction with navigation apparatus. The primary references, especially 
Yokoyama, present ideal platforms onto which different receivers may be installed to receive 
different types of information. It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to include receivers to access information pertaining to traffic, 
weather, and advertising in the navigation apparatus for the purpose of presenting pertinent 
information that may help the driver easier determine the route that should be taken. 

8. Claims 16 and 18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yokoyama et al in view of Knoll et al as applied to claim 1 1 above, and further in view of 
Trovato et al. 

For claim 16 . the method taught by the combination of references above includes the 
claimed subject matter as discussed in the rejection of claim 1 1 above. However, the method does 
not provide an indication of a desired action a predetermined time period in advance of the 
desired action. 

The portable system for providing voice driving directions taught by Trovato determines a 
range based on both distance and time from the current position to a position at which the 
instructions should be spoken. The time period accounts for the amount of time required to speak 
the instructions, for the reaction time of the driver at the speed that the system is moving in the 
vehicle and for an error in position associated with GPS systems. The obvious advantage of this 
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system is to provide real time instructions that are given to a driver well in advance of the 
upcoming turn thereby reducing driver error. 

All three references pertain to similar subject matter; that is, vehicle navigation systems. It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
provide information of a desired action a predetermined time period in advance of the turn for the 
purpose of reducing driver error. 

For claim 1 8 . the predetermined relationship of Trovato is estimated time to a desired 
location. 

9. Claims 27, 28, 34, and 35 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yokoyama et al in view of Knoll et al as applied to claims 26 and 32 above, and further in view 
ofOng [U.S. 6,285,317]. 

For claim 27 , the combination of references above includes the claimed subject matter as 
discussed in the rejection of claim 26 above. However, the pictures generated from both 
references are not live pictures. 

The navigation system with three-dimensional display taught by Ong includes similar 
subject matter as the two primary references; that is, a vehicle position data generator generates 
signals indicating the location of the vehicle as well as pictures to be displayed to the operator of 
the vehicle with driving directions superimposed thereon. As seen in Figures 4 and 8, one of the 
systems used to provide a picture to the operator in addition to 3D graphic Tenderers is a video 
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camera (No. 38) mounted to the vehicle itself. The picture is received by an image capture device 
(No. 44) onto which a driving direction is added. Heretofore, navigation systems have used local 
storage devices such as CD-ROM and up-to-the-minute information has not been readily 
available. The obvious advantage of this system is a realistic view of the territory ahead and the 
direction being clearly shown on said view. 

The primary references, particularly Yokoyama, present an ideal platform onto which a 
camera such as Ong's may be applied. The map information storage may not have the latest 
information and changes over time may certainly occur with construction or changes in traffic 
flow. It would have been obvious to one of ordinary skill in the art at the time the invention was 
made to include a camera such as that of Ong into the combination above to provide realistic, 
current information to the driver that can be easily understood and read. 

For claim 28 . the live picture of Ong is from a camera mounted over the roadway. 

For claim 34 , the method taught by the combination of references above include the 
claimed subject matter as discussed in the rejection of claim 32 above. However, the step of 
finding a picture is not receiving a live picture of the intersection. 

The claim is interpreted and rejected for the same reasons and rationale as is mentioned in 
the rejection of claim 27 above. 

For claim 35 . the live picture of Ong is from a camera mounted above the intersection. 
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Response to Arguments 



Argument 1: 

"Since the Yokoyama patent specifically teaches that the display of driving instructions is 
away from the driver's vision and the present invention as claimed places driving directions within 
the driver's vision, they are fundamentally different and diametrically opposed in concept, 
function, and operation." 

Argument 2: 

"Further, the combination of the teachings is improper when the one reference specifically 
teaches to avoid the features of the present invention, namely displaying information like driving 
directions in view of the driver as the driver is looking out the windshield. Thus, the combination 
of teachings of Knoll with Yokoyama would contradict the clear teachings of the Yokoyama 
reference." 

Argument 3: 

"The combination of references to make the present rejections may also represent an 
impermissible hindsight reconstruction « that is, the selection of bits and pieces from the prior art 
based on the teachings of applicant's own invention rather on some reason within the references 
to combine them. Of course, such hindsight reconstruction is improper and there must be not 
only the individual pieces but also a reason within the references to combine them." 



Application/Control Number: 09/676,598 
Art Unit: 2632 



Page 15 



10. Applicant's arguments filed 8/13/01 have been fully considered but they are not 
persuasive. 

Response to Argument 1: 

In response to applicant's arguments against the references individually, one cannot show 
nonobviousness by attacking references individually where the rejections are based on 
combinations of references. See In re Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981); In re 
Merck & Co., 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). 

Response to Argument 2: 

It appears that the applicant does not fully understand the justification of combining the 
two references or why the Knoll et al reference was introduced in the first place. When reading 
the citation of the Yokoyama reference by the applicant (Col. 3, Lns. 34-36), it appears that this 
is the perfect reason to combine or introduce the Knoll reference in the first place! According to 
the Yokoyama reference, the driver "can confirm the current position of the vehicle by watching 
the display unit 28 and can obtain information about a future route". Taking his eyes off the 
road? Long enough to distract him from his current driving duties? This may have been intended 
to be helpful, unfortunately an accident may occur resulting from the driver's inattention to the 
vehicle traversing the roadway. What better way to avoid such catastrophe than to shift the 
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driver's view to the windshield, where his view is always directed to the vehicle's route? This is 
certainly considered ample teaching or suggestion to combine the references. 

Response to Argument 3: 

In response to applicant's argument that the examiner's conclusion of obviousness is 
based upon improper hindsight reasoning, it must be recognized that any judgment on 
obviousness is in a sense necessarily a reconstruction based upon hindsight reasoning. But so 
long as it takes into account only knowledge which was within the level of ordinary skill at the 
time the claimed invention was made, and does not include knowledge gleaned only from the 
applicant's disclosure, such a reconstruction is proper. See In re McLaughlin, 443 F.2d 1392, 
170 USPQ 209 (CCPA1971). 

11. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
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CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

12. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

De Jong [U.S. 5,1 15,398] displays navigation data in conjunction with an image taken 
from a video camera. 

Ball [U.S. 6,285,297] uses a camera to scan a roadway and transmit information through 
a telephone link or radio transmitter. 

13. Any inquiry concerning this communication should be directed to Examiner John Tweel at 
telephone number (703) 308 7826. The examiner can normally be reached on Monday-Friday, 
9:30a-6:00p. 

If attempt to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Jeff Hofsass, can be reached on (703) 305 4717. The fax phone number for this group is (703) 
872 9314. 



November 4, 2001 



John Tweel 




